A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video based upon an 
event, wherein said event is characterized by a start time based upon 
when the ball is put into play and an end time based upon when the 
ball is considered out of play, where each of said segments includes 
a plurality of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

The method of claim 1 wherein said event is defined by the rules of football. 

The method of claim 1 wherein said start time is temporally proximate a 
hike. 

The method of claim 1 wherein said end time is temporally proximate a 
tackle of a player with the ball. 

A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, where each of said 
segments includes a pluraUty of frames of said video, based upon a 
series of activities defined by the rules of football that could 
potentially result in at least one of: 

(i) a score; 

(ii) preventing a score; 

(iii) advancing a team toward a score; 

(iv) preventing advancing a team toward a score; and 

(b) creating a summarization of said video by including said plurality of 
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segments, where said summarization includes fewer frames than said 
video. 

The method of claim 5 wherein said summarization of said plurality of 
segments is in the same temporal order as said plurality of segments within 
said video. 

The method of claim 5 wherein said activities are determined based upon 
the color characteristics of said video. 

The method of claim 5 wherein said activities are determined based upon 
scene changes. 

A method of processing a video including football comprising: 

(a) identifying a pluraUty of segments of said video based upon 
detecting a play of said football game, wherein said identifying 
includes detecting the start of said play and detecting the end of said 
play, where each of said segments includes a plurality of frames of 
said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

The method of claim 9 wherein said detecting the end of said play is based 
upon detecting said start of said play. 

The method of claim 9 wherein said summarization identifies said plurality 
of segments of said video. 

The method of claim 9 wherein said sununarization is a summarized video 
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comprising said plurality of segments excluding at least a portion of said 
video other than said plurality of segments. 



13. The method of claim 9 wherein said start is temporally close to the hike of 
the ball. 

10 

14. The method of claim 9 wherein said end is temporally close to a tackle of a 
player with the ball. 

15. A method of processing a video including football comprising: 

1 5 (a) identifying a plurality of segments of said video, wherein the start of 

said plurahty of segments is identified based upon detecting at least 
one spatial region of a generally green color, where each of said 
segments includes a plurality of frames of said video; and 
(b) creating a summarization of said video by including said plurality of 

20 segments, where said summarization includes fewer frames than said 

video. 

16. The method of claim 1 5 further comprising said spatial region having a 
substantially straight border. 
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17. The method of claim 15 further comprising said spatial region having a pair 
of substantially parallel edges. 

18. The method of claim 1 5 further comprising said spatial region being 
30 centrally located within said frame. 

19. The method of claim 1 5 wherein said generally green color is modified 
during said processing of said video. 
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The method of claim 15 wherein said generally green color is calculated 
based on the video and has a smaller gamut than an initial generally green 
color from which said generally green color is calculated based upon. 

A method of processing a video including football comprising: 

(a) identifying a plurahty of segments of said video, wherein the start of 
said plurality of segments is identified based upon detecting at least 
one spatial region of a generally brown color, where each of said 
segments includes a plurality of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

The method of claim 21 further comprising said spatial region having a 
substantially straight border. 

The method of claim 21 further comprising said spatial region having a pair 
of substantially parallel edges. 

The method of claim 21 further comprising said spatial region being 
centrally located within said frame. 

The method of claim 21 wherein said generally brown color is modified 
during said processing of said video. 

The method of claim 21 wherein said generally brown color is calculated 
based on the video and has a smaller gamut than an initial generally brown 
color from which said generally green color is calculated based upon. 

A method of processing a video including football comprising: 
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5 (a) identifying a plurality of segments of said video, wherein the start of 

said pluraUty of segments is identified based upon detecting multiple 
substantially parallel spaced apart substantially straight lines, where 
each of said segments includes a plurality of frames of said video; 
and 

1 0 (b) creating a summarization of said video by including said plurality of 

segments, where said summarization includes fewer frames than said 
video. 



28. The method of claim 27 wherein at least three of said straight lines intersect 
15 at substantially the same location. 

29. The method of claim 27 wherein said straight lines are generally white. 

30. The method of claim 27 wherein said substantially parallel lines are on a 
20 generally green background. 

3 1 . The method of claim 27 wherein said substantially parallel lines are on a 
generally brown background. 



25 32. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, wherein the start of 
said plurality of segments is identified based upon identifying 
multiple spaced apart generally white lines, where each of said 
segments includes a plurality of frames of said video; and 

30 (b) creating a summarization of said video by including said plurality of 

segments, where said summarization includes fewer frames than said 
video. 



33. The method of claim 32 wherein said white lines are substantially parallel to 
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one another. 



34. The method of claim 32 wherein at least three of said white lines intersect at 
substantially the same location, 

10 35 . The method of claim 32 wherein said white lines are on a generally green 

background. 

36. The method of claim 32 wherein said white lines have a sufficient length. 

15 37. The method of claim 32 where said length is based upon the size of a 

generally green region of said video. 

38. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, wherein the start of 
20 said plurality of segments is identified based upon identifying 

multiple spaced apart lines, wherein said hnes contrast with the 
background, where each of said segments includes a plurality of 
frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
25 segments, where said summarization includes fewer frames than said 

video. 

39. The method of claim 38 wherein said lines are generally white. 

30 40. The method of claim 38 wherein said background is generally green, 

41 . The method of claim 38 wherein said hnes are substantially parallel to one 
another. 
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5 42. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, wherein the start of 
said plurality of segments is identified based upon identifying a 
plurality of lines on a background primarily of a generally green 
color, where each of said segments includes a pluraUty of frames of 

10 said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

15 43 . The method of claim 42 wherein said lines are generally white. 

44. The method of claim 43 wherein at least three of said lines intersect at 
substantially the same location. 

20 45. The method of claim 42 wherein said generally green color is calibrated 

based upon said video. 

46. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, wherein the start of 
25 said plurahty of segments is identified based upon identifying a 

plurality of lines that converge to generally the same location, where 
each of said segments includes a plurality of fi-ames of said video; 
and 

(b) creating a summarization of said video by including said plurality of 
30 segments, where said summarization includes fewer frames than said 

video. 

47. The method of claim 46 wherein said lines are generally white. 
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5 48. The method of claim 46 wherein said lines are parallel in the image domain. 

49. The method of claim 46 wherein said lines are generally white and the 
background of said Hnes is generally green. 

10 50. The method of claim 46 wherein said generally same location is outside of 

the field of said football. 

5 1 . The method of claim 46 wherein said generally same location is outside of 
said frame of said video. 
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52. The method of claim 46 wherein said lines are identified on the same frame 
of said video. 

53. A method of processing a video including football comprising: 

20 (a) identifying a pluraUty of segments of said video, wherein the start of 

said plurahty of segments is identified based upon identifying the 
lack of significant motion in the image domain, where each of said 
segments includes a plurality of frames of said video; and 
(b) creating a summarization of said video by including said plurality of 

25 segments, where said summarization includes fewer frames than said 

video. 



54. The method of claim 53 wherein said start is further based upon identifying 
a generally green spatial region. 

30 

55. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, wherein the start of 
said plurahty of segments is identified based upon identifying a 
zooming of said video followed by said video being free from 
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significant motion, where each of said segments includes a plurality 
of frames of said video; and 
(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

The method of claim 55 wherein said start is further based upon identifying 
a generally green spatial region, 

A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, wherein the start of 
said pluraUty of segments is identified based upon identifying at 
least one non-generally green region that is consistent with a model 
of at least one of a color and a texture of the players uniform in said 
football video, where each of said segments includes a plurality of 
frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

The method of claim 57 wherein said non-generally green region has a 
generally linear alignment. 

The method of claim 57 wherein said generally linear arrangement includes 
at least two generally lines of non-generally green regions. 

A method of processing a video including football comprising: 

(a) identifying a plurahty of segments of said video, wherein said 

identifying for at least one of said segments includes detecting the 
start of said segment based upon processing of a first single frame of 

32 



said videOj where each of said segments includes a pluraUty of 
frames of said video; 

(b) verifying that said first single frame is an appropriate start of said 
segment based upon processing of another single frame temporally 
relevant to said first single frame; and 

(c) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

A method of processing a video including football comprising; 

(a) identifying a plurality of segments of said football video, wherein 
said identifying for the end of at least one of said segments is based 
upon detecting a scene change, where each of said segments 
includes a plurality of frames of said football video; and 

(b) creating a summarization of said football video by including said 
plurality of segments, where said summarization includes fewer 
frames than said football video. 

The method of claim 61 wherein said scene change is based upon a 
threshold between at least two frames. 

The method of claim 61 wherein said scene change is based upon a gradual 
transition below a threshold level. 

A method of processing a video including football comprising: 
(a) identifying a plurality of segments of said football video, wherein 
said identifying for the end of at least one of said segments is based 
upon detecting a pluraUty of scene changes, where the first scene 
change detected after the start of said at least one of said segments is 
free from being selected as said end of said at least one of said 
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segments, where each of said segments includes a plurality of frames 
of said football video; and 
(b) creating a summarization of said football video by including said 
plurality of segments, where said summarization includes fewer 
frames than said football video. 

A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, where each of said 
segments includes a plurality of frames of said video; 

(b) identifying a plurality of segments that are temporally separated by a 
sufficiently short duration; 

(c) based upon said identifying as a result of (b) connecting said 
identified plurality of segments; and 

(d) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

The method of claim 65 wherein said connecting includes discarding the 
frames of said video between said identified pluraHty of segments. 

The method of claim 65 wherein said connecting results in a single segment 
that includes said identified plurality of segments together with the frames 
of said video between said identified pluraUty of segments. 

A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video, where each of said 
segments includes a plurality of frames of said video; 

(b) identifying at least one of said segments that has a temporally 
sufficiently short duration; 

(c) based upon said identifying as a resuh of (b) removing said 



34 



5 identified segment from said summarization; and 

(d) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

10 69. The method of claim 68 wherein said connecting includes discarding the 

frames of said video between said identified pluraHty of segments. 

70. The method of claim 68 wherein said connecting results in a single segment 
that includes said identified plurality of segments together with the frames 

15 of said video between said identified plurality of segments. 

71 . A method of processing a video including football comprising: 

(a) identifying a pluraUty of segments of said video, wherein the start of 
said plurality of segments is identified based upon identifying two 

20 generally aligned sets of non-generally green regions, where each of 

said segments includes a plurahty of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video. 

25 

72. The method of claim 71 wherein said non-generally green regions are on a 
background of generally green. 

73. The method of claim 71 further comprising identifying a plurality of white 
30 lines. 

74. A method of processing a video including football comprising: 

(a) identifying a pluraUty of segments of said video wherein each of 
said segments includes a play of football; 
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5 (b) detecting a commercial within said video; 

(c) creating a sixmmarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video, where said pluraHty of segments of said video sufficiently 
temporally close to said commercial are free from being included 

1 0 within said summarization. 



75. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video wherein each of 
said segments includes a play of football, wherein said segments 

1 5 include fiill-speed plays and slow motion plays of said fiiU-speed 

plays; and 

(b) creating a summarization of said video by including said plurahty of 
segments, where said summarization includes fewer frames than said 
video, where a user may select from: 

20 (i) said summarization including only fiiU-speed plays; 

(ii) said summarization including only slow motion plays; 

(iii) said summarization including both frill-speed plays and slow 
motion plays. 

25 76. A method of processing a video including football comprising: 

(a) identifying a plurahty of segments of said video wherein each of 
said segments includes a play of football; 

(b) creating a summarization of said video by including said plurahty of 
segments, where said summarization includes fewer frames than said 

30 video; and 

(c) removing at least one of said segments from said summary based, at 
least in part, upon audio information related to said at least one of 
said segments. 
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77. 



The method of claim 76 wherein said audio information is obtained 
exclusively from a temporal analysis. 



78. A method of processing a video including football comprising: 

(a) identifying a plurality of segments of said video wherein each of 
10 said segments includes a play of football; 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said 
video; and 

(c) modifying the duration of at least one of said segments from said 
15 summary based, at least in part, upon audio information related to 

said at least one of said segments. 

79. The method of claim 78 wherein said audio information is obtained 
exclusively from a temporal analysis. 

20 

80. A method of processing a video comprising: 

(a) providing a description of said video; 

(b) identifying a plurality of segments of said video based upon said 
description; 

25 (c) generating another video based upon said identified segments, 

wherein said another video has less frames than said video. 

81. The method of claim 80 wherein said video is transcoded in accordance 
with the channel capacity of a transmission medium. 
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82. The method of claim 80 wherein said video is transcoded in accordance 
with the storage capacity of a storage device. 

83. The method of claim 80 wherein said description is compliant with MPEG- 



37 



5 



7 standard. 



84. The method of claim 80 wherein said description is compliant with TV- 
Anytime standard. 

10 85 . A method of processing a video comprising: 

(a) a service provider identifying a summary of said video; 

(b) a service provider identifying a description of said summary; and 

(c) said service provider providing said summary and said description to 
a remote user in response to receiving a request from said remote 

15 user. 

86. The method of claim 85 wherein said user requests said summary with a 
browser. 

20 87. A method of processing a video comprising: 

(a) a service provider storing a summary of a video; and 

(b) said service provider providing said summary to a remote user in 
response to receiving a request from said remote user. 

25 88, The method of claim 87 wherein said user requests said simmiary with a 

browser. 

89. A method of processing a video comprising: 

(a) a service provider storing a description of a summary of a video; and 
30 (b) said service provider providing said description to a remote user in 

response to receiving a request from said remote user. 

90. The method of claim 89 wherein said user requests said description with a 
browser. 
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